Strong invariance principles with rate for "reverse" martingales 

and applications. 

Christophe Cuny a and Florence Merlevede 6 

a Laboratoire MAS, Ecole Centrale de Paris, Grande Voie des Vignes, 92295 Chatenay-Malabry cedex, 
FRANCE. E-mail: christophe.cuny@ecp.fr 

b University Paris Est, LAMA, CNRS UMR 8050, Batiment Copernic, 5 Boulevard Descartes, 77435 
Champs-Sur-Marne, FRANCE. E-mail: florence.merlevede@univ-mlv.fr 

Abstract 

In this paper, we obtain almost sure invariance principles with rate of order n 1/,p log' 3 n, 2 < p < 4, 
for sums associated to a sequence of reverse martingale differences. Then, we apply those results to 
obtain similar conclusions in the context of some non-invertible dynamical systems. For instance we 
\ treat several classes of uniformly expanding maps of the interval (for possibly unbounded functions). 

A general result for (^-dependent sequences is obtained in the course. 
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1 Introduction 



Let T be a map from [0, 1] to [0, 1] preserving a probability v on [0, 1]. Let / be a measurable function 
such that v(\f\) < oo. Define S n (f) — Yh=o (/ ° ^ ~ V U))- According to the Birkhoff-Khintchine 
\ ergodic theorem, n~ 1 S n (f) satisfies the strong law of large numbers. One can go further in the study of 

the statistical properties of S n (f) and recently there have been extensive researches to study the almost 
sure invariance principle (ASIP) for S n (f). Roughly speaking, such a result ensures that the trajectories 
of a process can be matched with the trajectories of a Brownian motion in such a way that almost surely 
the error between the trajectories is negligible compared to the size of the trajectory. This result is more 
or less precise depending on the error term one obtains. In this paper, for some classes of uniformly 
[* — | expanding maps, we give conditions on / ensuring that there exists a sequence of independent identically 

t^- ■ distributed (iid) Gaussian random variables (Zi)i>i such that 

cn ; fc-i 

■ sup ^(/of-i/(/)-Z.) = o(n 1/p L(n)) almost surely, (1.1) 

O 1 1 ^ fc ^« i=0 



for p g]2,4] and L an explicit slowly varying function. For different classes of piecewise expanding maps 
T of [0,1], almost sure invariance principles with good remainder estimates have been established by 
Melbourne and Nicol ([17]. [TS] ) for Holder observables, and by Merlevede and Rio [21] under rather 
mild intcgrability assumptions. For instance, for uniformly expanding maps as defined in Definition 13. 11 



Merlevede and Rio [21] obtained in (jl.ip a rate of order n 1 / 3 (logn) 1 / 2 (loglogn) ( ^ 1+£ ^ 3 for any e > 
and a class of observables / in U(u) where r > 3. Because of the intrinsic time-orientation of the non- 
invertible dynamical systems studied in the papers above mentioned, the almost sure invariance principle 
cannot be obtained directly by mean of a martingale approximation as done for instance in [10) . In [21) . 
the approximating Brownian motion is constructed with the help of the conditional quantile transform 
combined with a coupling method based, roughly speaking, on a conditional version of the Kantorovitch- 
Rubinstein theorem. The approach used in [17] or in [18] when d = 1 (see their appendix A) is based on 
the seminal paper by Philipp and Stout |24] which proves ASIP by combining martingale approximation 
with blocking arguments and the Strassen-Skorohod embedding. With this approach, they cannot reach 
better rates than 0(n e+3 / 8 ) in (|1.1[) for any e > (see Remark 1.7 in [IB])- Notice that recently Gouezel 
|11] obtained a very general result concerning the rates in the ASIP for vector-valued observables of the 
iterates of dynamical systems by mean of spectral methods. In the particular case of expanding maps as 
defined in Definition 13. 11 his result gives the rate o(n 1 / 4+e ) for any e > for some bounded vector- valued 
observables. 
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On an other hand if we consider the strong approximation principle of the partial sums of real- valued 
functions of the Markov chain associated to the dynamical system, better rates can be reached. Let denote 
by K the Perron-Frobenius operator of T with respect to v. Recall that for any bounded measurable 
functions / and g, 

v{f-goT) = v{K{f)g). (1.2) 

Let (li)i>o be a stationary Markov chain with invariant measure v and transition Kernel K. The sequence 
(Yi)i>o corresponds to the iteration of the inverse branches of T. Combining a suitable martingale 
approximation with a sharp control of the approximation error in L p for p > 2, and the Skorohod- 
Strassen embedding theorem as done in Shao Theorem 2.1], Dedecker, Merlevede and Doukhan [3] 
obtained projective conditions under which the strong approximation holds with an explicit rate, as in 
(jl.ip . for the partial sums associated to a stationary sequence of real valued random variables. In the 
Markov chain setting, the conditions involved in their corollaries 2.1 and 2.2 can be rewritten with the 
help of the transition kernel K. One can then wonder whether under the same conditions, the strong 
approximation principle also holds with the same rate for the partial sums associated to some observables 
of the iterates of the dynamical system. Indeed, it is well known (see for instance Lemma XI.3 in Hennion 
and Herve [T5] ) that on the probability space ([0, 1], v), the random vector (T, T 2 , . . . , T n ) is distributed as 
(Y n> Y n -i, . . . , Y\). Hence any information on the law of Y^i=iU ' °T l — v{f)) can be obtained by studying 
the law of 5Z i=1 (/(-Xi) — K/))- However, the reverse time property cannot be used to transfer directly 
the almost sure results for Y^i=i(f(Yi) — v{f)) to the sum J27=i(f °T l — f (/))■ To prove results on the 
strong approximation principle for the partial sums of functions of the iterates of the dynamical system, 
it is then needed to work on the dynamical system itself. Therefore to prove that Y^A=i(f ° T l — K/)) 
satisfies a strong approximation principle with the same rates than the one reached for the associated 
Markov chain, we shall approximate the partial sum associated to real-valued observables of the iterates 
of the dynamical system by a sum of reverse martingale differences M*. To be more precise, we shall 
approximate S n (f) by M* = Ylk=i^k wriere (d1)ken is a sequence of real valued random variables 
that is measurable with respect to a non-increasing sequence of cr-algebras say (Gk)keN ancl such that 
E(d£|<?fc+i) = almost surely. An analogue of Theorem 2.1 in Shao [26] but in the context of the partial 
sums associated to a sequence of reverse martingale differences, is then needed. Up to our knowledge, 
this version for reverse martingale differences sequences does not exist in the literature. Starting from a 
reverse martingale version of the Skorohod-Strassen embedding theorem as done in Scott and Huggins 
[25] . we shall prove it in Section [2J (see our Theorem I2.3[) . 

Our paper is organized as follows. In Section [2] we state some results concerning the almost sure 
invariance principle with rates for sums associated to a sequence of reverse martingale differences. The 
proofs of these results are postponed to Section [5] In Section [31 we obtain rates of convergence in the 
ASIP for the sum of a large class of functions (non necessarily bounded) of the iterates of some classes 
of uniformly expanding maps, as well as for the partial sum associated to the corresponding Markov 
chain. A part of these results coming from a more general result on ^-dependent sequences, we state and 
prove in Section [¥] an ASIP with explicit rates for functions of a stationary sequence satisfying a mild 
(^-dependent condition. Section [5J is devoted to the proofs of the results on expanding maps stated in 
Section [3] 

In this paper, we shall use sometimes the notation a n -C b n to mean that there exists a numerical 
constant C not depending on n such that a n < C'b n , for all positive integers n. 

2 ASIP with rates for sums of differences of reverse martingales 

The next two results can be viewed as reverse martingales analogues to a result of Shao [2S1 Theorem 2.1]. 
The proof of the next result follows from the Skorohod embedding of reverse martingales in Brownian 
motion as obtained in Scott and Huggins [25] together with an estimate for Brownian motions given 
in Hanson and Russo [T2J Theorem 3. 2 A]. The proofs of all the results presented in this section are 
postponed to Section [BJ 

In this section we consider real random variables defined on a probability space (£l,A, P). 

Proposition 2.1 Let (£ n )neN be a sequence of square integrable variables adapted to a non-increasing 
filtration (Gn)neN- Assume that E(£ n |<?n+i) = a.s. and <5 2 := J2k>n^(£k) < 00 ■ Then := 
J2k>n ^(Cfcl^fc+i) * s we M defined a.s. and in L 2 as well as R n = J2k>n£k- Let (a n ) n eti be a sequence of 
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non-increasing positive numbers with a n — 0(5^) and a n /S* — > oo. Assume that 

Vn - S 2 n = o(a n ) F-a.s. (2.1) 
^2ot~ v E(\^ n \ 2v ) for somel <v <2. (2.2) 

Then, enlarging our probability space if necessary it is possible to find a standard Brownian motion 
{Bt)t>o, such that 

Rn-B sl = ((a n (|log(^/a n )|+loglog(a- 1 ))) 1/2 ) P-a.s. (2.3) 

Remark 2.2 It follows from the proof that if (|2.1[) holds with "big O" instead of "little o" then (|2.3p 
holds with the same change. 

Now, we give a result for partial sums associated to a sequence of reverse martingale differences rather 
than for tail series. It may be viewed as the analogue of Theorem 2.1 in Shao [55] but in the context of 
reverse martingale differences. 

Theorem 2.3 Let (X n ) n ^ be a sequence of square integrable random variables adapted to a non- 
increasing filtration (Gn)neN- Assume that K(X n \Q n +x) = a.s., that a 2 := X}fc=i ^(-^fc) 00 an d that 
sup„E(JT 2 ) < oo. Let (a n )n£N be a non- decreasing sequence of positive numbers such that (a n /er^)„ e jq is 
non-increasing and (a n /a n ) ne fi is non- decreasing. Assume that 

n 

^(milGk+i) - E(X%)) = o(a n ) P-a.s. (2.4) 
fc=i 

a n V H\ X n? V ) < oo for some l<v<2. (2.5) 

n>l 

Then, enlarging our probability space if necessary it is possible to find a sequence (Zk)k>i of independent 
centered Gaussian variables with E(Z^) = E(X 2 ) such that 

k k 

sup |^X l -^Z l Uo((a„(|log( t T2/ a „)| + lo g loga I1 )) 1/2 ) P-a.s. (2.6) 

— — 2—1 % — \ 

Remark 2.4 An inspection of the proof allows to weaken slightly some of the assumptions as follows. 
Assume that E{Xf l ) = O^ff) for some < s < 1 instead of boundedness and assume that there exists 
C > 1, such that for every n>l, sup fc>n (afc/cr|) < Ca n /a^, and inffc>„(afc/<7fc) > a n /(Co n ), instead of 
the corresponding monotonicity assumptions. 

We derive now the functional LIL for the partial sums associated to a stationary and ergodic sequence 
of reverse martingale differences. In the next corollaries, we make use of 9 : 57 M> £1 a measurable 
transformation preserving the probability P. 

Corollary 2.5 Let Xq in L 2 and for n > 1, X n — Xq o 9". Assume that 9 is ergodic. Let {Q n )n>o be a 
non-increasing filtration to which (X n ) n >o * s adapted and such that E{X n \Q n+ \) = a.s. Enlarging our 
probability space if necessary it is possible to find a sequence (Zk)k>i of independent centered Gaussian 
variables with E(Z^) = E(Xf) such that 

k k 

sup Xi - ^Zi = o^nloglogn) P-a.s. (2.7) 

i<fc<„ i=1 i=1 

Remark 2.6 The Strassen functional law of the iterated logarithm (FLIL) follows from the corollary. 
Notice that a semi-FLIL has been proved by Wu f28f . 

We now give rate results in the strong invariance principle for the partial sums associated to a 
stationary sequence of reverse martingale differences. 



3 



Corollary 2.7 Let 2 < p < 4. Let Xo be in V and for n > 1, X n = Xo o 9 n . Let (G n )n>o be a non- 
increasing filtration to which (X n ) n >o is adapted and such that K(X n \G n +i) = a - s - Let b(-) be a positive 
non- decreasing slowly varying function, such that x i— > x 2 / p_1 fe(a;) is non-increasing. Assume that 

n 

^(E(X fc 2 |g fe+1 )-E(X fc 2 ))- (n 2 /f6(n)) P-a.s. (2.8) 
fe=i 

Enlarging our probability space if necessary it is possible to find a sequence (Zk)k>i of independent centered 
Gaussian variables with E(Z|) = E(X 2 ) such that 

k k 

sup \Y, Xi ~lL, Zi \ =o(n 1/p y/b(n)logn) P-a.s. (2.9) 

Corollary 2.8 Let Qq be a sub-o -algebra of A satisfying 0~ 1 (Q O ) C Q . Let X$ be a Go-measurable 
random variable in L 4 . For n > 1, let X n = Xq o 9 n and Q n = 9~ n (Go). Assume that 8 is ergodic and 
that ~E(X n \G n +i) = a.s. Assume that 

n 

^(mllGk+i) - E(XD) = 0((n\og\ogn)V 2 ) P-a.s. 

fc=i 

Enlarging our probability space if necessary it is possible to find a sequence (Zk)k>i of independent centered 
Gaussian variables with E(Z^) = E(X 2 ) such that 

k k 

sup \J2 X *~J2 Z *\ =0(n 1 / 4 (logn) 1/2 (loglogn) 1 / 4 ) P-a.s. (2.10) 

i<fc<J . =1 . =1 

Remark 2.9 If we consider usual martingale differences, so more precisely if (X n ) n£ N * s a stationary 
sequence in L p for a real p €]2, 4] adapted to a non- decreasing filtration (J r „) n gN (assume moreover that 
J- n = 9~ n J-Q when p = A) and such that E(X„|J r n _i) = a.s., the usual Skorohod-Strassen embedding 
theorem gives similar results to Corollaries \2.7\ and \2.8[ Indeed starting from Theorem 2.1 in Shao \26f 
when p G]2, 4[ or from its proof when p = 4 ( notice that by stationarity -of the process and the filtration-, 
the stopping times used to construct the approximating Brownian motion can be chosen to be stationary), 
and using the arguments developed to get Corollaries \2.7\ and \2.8l we infer that if there exists a positive 
non- decreasing slowly varying function b(-), such that 

n 

^(E(Xfc|J*fe_i) -E(Xfe)) = o(n 2/p b(n)) P-a.s. when p e]2, 4], 
fc=i 

or if, (X n ) ne fj is ergodic and 

n 

^(E(X||J" fc _i) -E(Xl)) = 0((nloglogn) 1/2 ) P-a.s. when p = 4, 
fc=i 

then, enlarging our probability space if necessary it is possible to find a sequence (Zk)k>i of independent 
centered Gaussian variables with E(Z 2 ) = E(X 2 ) such that the rates of approximation in the strong 
invariance principle are the same as those given by (|2.9D and (|2.10D . 

3 ASIP with rates for uniformly expanding maps 

Several classes of uniformly expanding maps of the interval are considered in the literature. In Theorem 
13.41 below, we shall consider the following definition: 

Definition 3.1 A map T : [0, 1] — > [0, 1] is uniformly expanding if it belongs to the class C defined in 
Broise J7J Section 2.1 page 11] and if 

1. There is a unique absolutely continuous invariant probability measure v, whose density h is such 
that -i-l^x) has bounded variation. 
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2. The system (T, v) is mixing in the ergodic theoretic sense. 

We refer also to Definition 1.1 in [5] for a more complete description. Some well known examples of maps 
satisfying the above conditions are: 

1. T(x) = (3x — [fix] for (3 > 1. These maps are called /3-transformations. 

2. I is the finite union of disjoint intervals (Ik)i<k<n, and T{x) = a^x + on 2^, with \dk\ > 1. 

3. T(x) = a(x^ 1 — 1) — [a{x~ l — 1)] for some a > 0. For a = 1, this transformation is known as the 
Gauss map. 

Our aim is to obtain explicit rates in the strong invariance principle for ^2" = q(/ ° T l — u(f)) and 
Y2i=i(f{Y%) — K/)) ((^*)*>o corresponding to the iterations of the inverse branches of T) when T is a 
dynamical system defined in Definition 13.11 and / belongs to a large class of functions non necessarily 
bounded. Such classes are described in the following definition. 

Definition 3.2 If /i is a probability measure on M and p € [2, oo), M € (0, oo), let Mon p (M, /i) denote 
the set of functions f : R — > R which are monotonic on some interval and null elsewhere and such that 
A*(I/I P ) — Monp(M, /x) &e £/ie closure in L p (/i) o/ £/ie set of functions which can be written as 

J2e=i a ^ l > where J2e=i M ^ 1 anrf e Mon p (M, /x). 

Remark 3.3 In previous papers, see for instance J6'J, the closure in L 1 (/i) was used in the definition 
above. It turns out that both definitions coincide. Indeed, a sequence bounded in L p (/z) and converging in 
L 1 (/x), converges for the weak topology in L p (/i). To conclude, recall that, by the Hahn-Banach theorem, 
in any Banach space, the weak closure of a convex set is equal to its strong closure. 

Our main theorem follows. For uniformly expanding maps as defined in Definition 13.11 it involves an 
L p -integrability condition of the observables. 

Theorem 3.4 Let T be a uniformly expanding map as defined in Dehnition \3.1\ with absolutely contin- 
uous invariant measure v. Let p g]2, 4], Then, for any M > and any f G Mon^M, v), the series 

a 2 = a 2 (/) = „((/ - v{f)f) + 2 £ „((/ - K/))/ ° T k ) (3.1) 

fc>o 

converges absolutely to some non negative number. 

1. Let (Yi)i>i be a stationary Markov chain with transition kernel K defined by (|1.2|) and invariant 
measure v. Enlarging the underlying probability space if necessary, there exists a sequence (^i)i>o 
of iid Gaussian random variables with mean zero and variance a 2 defined by (I3.1[) . such that 



sup \t:m)-»v))-z< 



dy/Ptlogn) 1 - 2 ^) a.s. i/pe]2,4[ 
©(^(logn^/^loglogn) 1 / 4 ) a.s. i/p = 4. 



2. Enlarging the probability space ([0, 1], v) if necessary, there exists a sequence (Z*)i>o of iid Gaussian 
random variables with mean zero and variance a 2 defined by (I3.ip . such that 

' 1 ' o(n 1 / p (logn) 1 - 2 / p ) a.s. if P e]2A[ 



sup | XXfoT* -!/(/)) 



X<k<n 



i=0 



0(n 1 / 4 (logn) 1 / 2 (l glogn) 1 / 4 ) a.s. ifp = A. 



As we shall see in the proof of Theorem 13.41 Item 1 will follow from a more general result on ^-dependent 
sequences. This general result is presented in a separate section (see Section [4]) since it has an interest in 
itself. Item 2 is obtained by considering an approximation by partial sums associated to a sequence (which 
is non stationary when p g]2,4[) of reverse martingale differences and by applying the results of Section 
[2J As we shall see, the reverse time property mentioned in the introduction allows to make links with 
estimates obtained to prove Item 1. Notice that when p = 2, the strong invariance principle (therefore 
with the rate o(n 1/ ' 2 (loglogn) 1 / 2 )) has been proved recently in [6] (see Item 3 of their Theorem 1.5). 
Notice that the proof of the strong invariance principle obtained in [B] combines different approximation 
arguments. The observable is approximated by a function with better integrability properties, the almost 
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sure invariance principle with rates obtained in |21| is then used for this new function, and a bounded 
law of the iterated logarithm is proved to make it possible to pass the results from the better function to 
the original function. Let us emphasize that the strong invariance principle obtained in [B] could be also 
proved by using a direct approximation by partial sums associated to a sequence of reverse martingale 
differences as we do in the proof of Theorem 13.41 above, and by using our Corollarv l2.5l 

Let us mention that when p = 4, Theorem 13.41 is a consequence of the following more general result. 

Theorem 3.5 Let T be a map from [0, 1] to [0, 1] preserving a probability v on [0, 1], and let K be defined 

by (|1.2p . Let f be a measurable function such that ^(/ 4 ) < oo. Assume that there exists 7 <e]0, 1] such 
that 

£(logn) 3 n^||X«(/) - u(f)\\%u < 00 , (3.2) 

n>0 

and 

]T(logn) 3 n 2 ^ sup \\K\fK^{f)) - v{fK^{f))\\lv < °° . (3.3) 

Then, the series a 2 defined by (|3.1j) converges absolutely and both items of Theorem \S.4\ holds with rate 
0(n 1 / 4 (logn) 1 /2(l glogn) 1 / 4 ). 

Remark 3.6 We would like to emphasize that the strategy of proof of Item 2 for both Theorems \3.J\ 
and VS. HA is to approximate S n (f) — 27=0 (/ T l — v(f)) by a partial sum associated to a sequence of 
reverse martingale differences (possibly non stationary), let say M* = Y^"—q d*, to apply our strong 
approximation results given in Section and to have a nice control of the approximation error between 
S n (f) and M*. A careful analysis of the proof of Theorem 2.4 and its Corollary 2.7 in 01/ together with 
the arguments developed in the proof of Item 2 of our Theorems \3.4\ and \3.5l show that our strategy of 
proof also gives new results when we consider classes of expanding maps with a neutral fixed point at zero 
such as the generalized Pomeau-Manneville (GPM) map as defined in Definition 1.1 of J3J/. Therefore we 
infer that if T is a GPM map with parameter 7 € (0, 1) and f is a function satisfying Condition (3.22) 
in J^j, then the conclusion of Corollary 3.18 in J^j also holds for S n (f). In particular, if f is a bounded 
variation function and T is a GPM map with parameter 7 6 (0, <5 _1 ] where 5 = p + I — 2/p and p €]2, 4], 
then S n (f ) satisfies an almost sure invariance principle with rate o(rt 1 / p logn). 

For a map T from [0, 1] to [0, 1] preserving a probability v on [0, 1] and (li)»>o its associated Markov chain 
with invariant measure v and transition Kernel K defined by (11.21) , Theorem 13.51 also allows to obtain 
rates in the strong invariance principle for X)™=i(/ °T l — v(f)) (or for the partial sum of its associated 
Markov chain) when / has a modulus of continuity that is dominated by a concave and non-decreasing 
function and the condition (|3.4p below is satisfied. 

For any integer k, we denote by Qk the operator defined as follows: E,(g(Yo,Yk)\Yo = x) = Qk(g)(x). 
Let Ai(R) be the set of functions from K to M that are 1-Lipschitz and let Ai(R 2 ) be the set of functions 
h from R 2 to R such that 

\h(xi,yi) - h(x 2 ,y 2 )\ < ^\xi - x 2 \ + ^\yi - y 2 \ ■ 

Denote by || • ||oo.p the essential supremum norm with respect to v. Assume that there exist C > and 
p €]0, 1[ such that for any e N 2 , 

sup \\K i (g)-p(g)\\ 00iU <Cp l and sup sup \\K l o Q^h) - v{Q j [h))\\ 00 , v < Cp l . (3.4) 

geAi(R) 3>0heA 1 (R 2 ) 



Theorem 3.7 Let T be a map from [0, 1] to [0, 1] preserving a probability v on [0, 1] and let (Yi)i>o be 
a stationary Markov chain with invariant measure v and transition Kernel K defined by (|1.2[) . Assume 
that condition (|3.4|) is satisfied. Let f from R to R such that \ f[x) — f(y)\ < c(\x — y\), for some concave 
and non- decreasing function c satisfying 




Then the conclusion of Theorem \3.5\ holds. 







Note that d33J) holds if c(t) < D\ log(t)|" 7 for some D > and some 7 > 1 + 2/\/3. Therefore Theorem 
13.71 applies to the functions from [0, 1] to R which are a-Holdcr for some a £]0, 1]. 

Dedecker and Prieur [9l Section 7.2, Example 4.4] have shown that condition (13.4[) is satisfied for a 
large class of uniformly expanding maps such as those considered in [2]. The conditions imposed on the 
class of the expanding maps they consider are slightly more restrictive than those considered in Definition 
13.11 In particular they are defined by mean of finite partitions of [0, 1]. 



4 A general ASIP result for a class of weakly dependent se- 
quences 

Let (O, A, P) be a probability space, and let 6 : Vt i-> Q be a bijective bimeasurable transformation 
preserving the probability P. Let be a sub-c-algebra of A satisfying C 0~ 1 (J 7 o). Define the 
nondecreasing filtration (J-i)igz by Ti — 9~ 1 (J 7 q). We shall sometimes denote by Ej the conditional 
expectation with respect to and we shall set Pi(-) = Ej(-) — Ej_i(-). 

Definition 4.1 For any integrable random variable X, let us write X^ = X — E(X). For any random 
variable Y = (Yi, • • • , Y&) with values in M fe and any a-algebra J- , let 



T 



4>{T,Y) = sup E(TT(i y ,< x ,)< > ~ v ' 

(x 1 ,...,x k )m k 1 V J=1 

For a sequence Y = (li)igz, where Yi = Yq o 0* and Y"o is an J-q -measurable and real-valued random 
variable, let 

<t>k,y(n) = max sup ^(Jb, • • • j^i,)) • 
l<J<fc n <ii<...<ij 

Theorem 4.2 Let = f(Yi) — E(/(Y)), where Yi = Y Q o8 l and Y is an Fa-measurable random variable. 
Let Py be the distribution 0/Y0 and p s]2,4]. Assume that f belongs to Mon^(M, Py ) for some M > 
and that 



J2k 1/V *~ 1/2 <t>2,Y( k ) < 00 i/pe]2,4[ and ^(log kfk 2 '^<j) 2 .y{k) < 00 ifp = 4. (4.1) 

k>l k>2 



Then, enlarging our probability space if necessary, there exists a sequence (^i)i>o of iid Gaussian random 
variables with mean zero and variance a 2 defined by the absolutely converging series 

a 2 =J2Cov(X„,X k ) (4.2) 

fcez 

such that 

k 



sup \YiXi-Zi) =( 

l<fe<ri 1 ~[ y 



o(n 1 /P(logn) 1 - 2 / p ) a.s. if P e]2,4[ 
O^/^logn^/^loglogn) 1 / 4 ) a.s. if p = 4. 



Notice that an application of Corollary 2.1 in [3] would give a rate of convergence ofordero(n 1 /P(logn)( t + 1 )/ 2 ) 
with t > 2/p. As we shall see in the proof of the above theorem, the improvement of the power in the 
logarithmic term is achieved via some truncation arguments. 

The proof makes use of the following lemma (see Lemma 5.2 in Dedecker, Gouezel and Merlevede [5]). 



Lemma 4.3 Let~Y — (Yi)j E z, where Yi = Yqo9 1 andYo is an J- -measurable random variable. Let f and 
g be two functions from K to M which are monotonic on some interval and null elsewhere. Let p £ [1, 00]. 
If \\f(Yo)\\ p < 00, then, for any positive integer k, 

||E(/(y fc )|j- ) - Hf(Y k ))\\ P < 2(2^ Y (fc))(p- 1 )/i/(y )H P . 

If moreover p > 2 and ||<?(Yq)|| p < o°> then for any positive integers i > j > k, 
||E(/(Y^%(Y,)(°)|.Fo)-E(/(Y^^ 
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4.1 Proof of Theorem 14.21 for 2 < p < 4 

Let / £ Mon£(M, P Yo ). We shall first prove that J2e>o II E o(^)IIp < 00 provided that J2 k >i ( t ) [ P ^ 1)/P ( k ) < 
oo (notice that this condition is implied by (|4.1lT ). This will entail that do := YIi>qPo{Xi) and 
ro := Yloi^oi^i) are we U defined and that we have the martingale-coboundary decomposition Xq — 
do + r o O^ 1 — r - Then the series a 2 = Xfcez Cov(X , X k ) will converge absolutely and we will have 
lim„^ 00 n- 1 E(^(/)) = a 2 . 

Since / £ Mon p (M,Py ), by definition, there exists a sequence of functions 

L 

fh = y^ J ak,Lfk,L , (4.3) 
fc=i 

with fk t L belonging to Mon p (M, Py ) and Ylk=i \ a k.L | < 1, such that Jl converges in L p (Py ) to /. Hence, 

||E pf £ )|| p = limj^o ||Eo(/i(y/)-E(/ x (yi))|| p < liminfi^oo Efc=i K^l Po(/fc,L(^) - E(A.l(^))|| p . 
Next, by Lemma 1431 we have \\E (f k>L (Y e ) - E(f kiL (Y e ))\\ p < 2(20i, Y (fc)) (p_1)/p M. This shows that 

J2i>o II e oP^)IIp < oo as soon as J2k>i 4>\-y ' % < 00 • 

We shall define random variables by truncating the functions f k ,L defined in (14.3[) . Let j be a positive 
integer and 

gj (x) = xl ]xl < c{j) where c(j) = 2 j / p j- 2 > p . 

Define then 

L 

h.j = ^2 ak ' L g i ° f k < L ■ ( 4 - 4 ) 

k=l 

By assumption and by construction, for any integers j, L, Jlj has a variation bounded by 4c(j). Hence, by 
Lemma 2.1 of [B], (/lj)l admits a subsequence, say (jwn j)i converging in L 1 (Py ), hence in L p (Py )), 
say to fj. Then, / — fj is the limit in L p (Py ) of 

V{L) 

U(L) ~ U(L),j = a k,v(L)9j ° fk.L where g } = xl\ x \ >c (j) . 
fe=i 

Define then for any integer £, 

X i4 := /,(r,) - E(£(y 4 )) and := (/ - /,)(r,) - E((/ - f ){Y t )) , (4.5) 

and 

:= U(L),j( Y e)- E (U(L)A Y t)) ™dX jtL ,t := (/^-/^JW-Ea/^)-/^-)^)). (4-6) 

We define also a sequence of martingale differences, (dj/)f>i, with respect to the non-decreasing sequence 
of cr-algebras (J 7 e)e>i, as follows: 

k>e 

Notice that by assumption (14.11) . the series Efc>o -^o converges in L°° as shown by the following 

claim whose proof is given later. 

Claim 1 Let j be fixed. Assume that Efe>i^i,Y(&) < oo. Then X/c>o H E o (-^j'i*) < °°> anc ^ ^ e 
sequence (djj)i>i defined by (|4.7I) forms a stationary sequence of martingale differences in L°° n/ii/i 
respect to the non- decreasing sequence of a -algebras {^Fe)t>i- 

We define now some non stationary sequences (Xe)e>i and (de)e>i as follows: 

dx := 4i , := X Xi i , (4.8) 
and, for every j > and every £ £ {2- J + 1, 2 J+1 }, 

<fc := dj-,< , X t := X jti . (4.9) 
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For every positive integer n, we then define 

n n 

M n {f):=Y,di and S n (/) := YJ . 
t=i e—i 

With these notations, the following decomposition is valid: for any positive integer k, 

S k (f) = (S k (f) - S k (f)) + (S k (f) - M k (f)) + M k (f) . 

Therefore, the theorem will follow if we can prove that 

sup |5 fc (/) - S k (f)\ = o(n x /f (log n) x - 2 ' p ) almost surely, (4.10) 

Kk<n 



sup 

Kk<n 



\S k (f) ~ M k (f)\ = o{n 1 ^{\ogn) 1 ' 2 / p ) almost surely, (4.11) 



and if, enlarging our probability space if necessary, there exists a sequence (Zj)i>o of iid Gaussian random 
variables with mean zero and variance a 2 such that 



k 

sup I V(J, - Zi) = o{n 1/p (log n)^ 2/p ) almost surely. (4.12) 

Kk<n 1 ' ' 



i=l 



Proof of (14. 10)) . For any non negative integer j, let 

k+2 j k+2 j 

Dj := sup | VJ (X e - X t )\ = sup | VJ X M \ , 

l<fc<2J £—23+1 l<fc<23 £—23+1 

where X jti is defined by Let iV G N* and let k e]l, 2 N ]. We first notice that Dj > | Y%=2*+1 I 

so if K is the integer such that 2 K ~ 1 < k < 2 K , then 



\S k (f) - S k (f)\ < \X 1 -X 1 \ + Vj£> 

j'=o 



n 



Consequently since K < N, 

N-l 

\S k (f) - S k (f)\ < \x 1 -x 1 \ + 

l<k<2 N 

Therefore, (14. 10)) will follow if we can prove that 

k+2 j 



sup ^ \S k (f) - S k (f)\ < \Xi - X X \ + £ D 3 ■ (4-13) 



By stationarity, this will hold true as soon as 



sup VJ =o(i 1 - 2 / p 2 i / p ) a.s. 



Ell SUp 1<fc<2 3 I ^=1^7V|||1 ^ ^i/n 
" 2 ^7p 7 -2-4/p <0 °' ( 4 ' 14 ) 



This is achieved by the following claim whose proof is given later. 
Claim 2 Assume that 



^r 1 ^5w< 00 ' ( 4 - 15 ) 



k>l 



Then gHH ZioZds. 
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Proof of (|4.11j) . For any non negative integer j, let 

k+2 3 



D 



j .— sup 

X<k<2) 



sup 

Kk<2i 



k+2 3 



d j,i) 



Following the beginning of the proof of (|4.10l) , we get that 



JV-l 



sup |5 fc (/)-Mfc(/)|<|^i-<ii|+ 

l<fc<2« J=Q 



Therefore we infer that (|4.11l) will hold if 



k+2 3 



sup J2 (Xj^-djj) =o(i 1 " 2 / p 2^f) a.s. 



Kk<2i 



=23+1 



By stationarity, this will hold true as soon as 



E 

3>1 



24j/pj4(l-2/p) 



< oo . 



This is achieved by the following claim whose proof is given later. 
Claim 3 Assume that 



k>l 



Then (j4~T6l) holds. 

Proof of (|4.12j) . Let a n = n 2 / p (logn) 1_4 / p . The result will follow from the following claim. 
Claim 4 Assume that 



and that 



J2aJ u E(\d e \ 2v ) <oo for some 1 < v < 2 , 
t>l 

n 

(Ei-i(d?) " E(d?)) = o(a n ) a.s. 

8=1 

Then (|4T2l) holds. 

It remains to show that (|4.18p and (|4.19[) are satisfied. 
Proof of (|4.18|) . We show it for v = 2. Notice first that 

2 j + 1 2 j + 1 

5>7 2 e(ki 4 ) = £ y «7 2 ie(i^i 4 )«E 24j / P72 1 (i-4/p) E E (fei 4 ), 

l>2 j>0e=2i + l j>0 - J £=23+1 

where d^i is defined in (|4.7p . By stationarity and Lemma 5.1 in [3], 



fell* < E H p o \u « E( £ + i) -174 !!^ (x. 



ii 4 • 



£>0 



(4.16) 



(4.17) 



(4.18) 



(4.19) 



(4.20) 



Using the arguments at the beginning of the proof of Claim [TJ we first observe that {Xj t L,i)L>\ defined 



converges in L to Xj^. Hence 



Po {X j>t ) || 4 = £ lim ||E (X^ L j) || 4 



(4.21) 



Next 



<p(L) 



JEo (X jtLtt ) \U < Y -E( gj of k<AL) (Y e )) || 4 . 



k=l 
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Applying Lemma T4.31 we then derive that 

tp(L) 

||Eo (X j>Lii ) || 4 < 2(20!, Y (£)) 3 / 4 £ Wk tV (L)\\\9j o / fe ^( L )(>o)||4 ■ 

fc=i 

Therefore starting from (|4.20p . we get that 

<p{L) 

||J^|| 4 « Uminf Y, \^, vi L)\\\9j ° / W )(>o)||4^r 1/4 (0i, Y (fc)) 3/4 



fc=l £>0 



Since X}fc=a l a fc l¥ )(L)l < 1) Jensen's inequality leads to 

V {L) 

||4,|| 4 « Uminf J2 K v w\\\9j /^(l)(^»)||!(E^ 1/4 (^.yW) 3/4 
fe=i e>o 

Hence, using condition (I4.1[) and Fubini, there exists a positive constant C not depending on L such that 
— , 1 23+1 

H 2 4 j/P 7 2(l-4/p) E E (l4/| 4 ) 

« Ummf E K v(i) lE 2 4 J 7p ? 2( P -4)/ P E (/fc, y w( y o)l|/ fc „ (L) (y )|< 2J / Pj -Vp) 

fc=l j>0 J 

« E K*>(£)l £ (^TfJ E (/L(i)( y o)l|/ fc ,, (i) (y )l<2 J / Pj -vP 

fe=l j>0 
V (L) 

< C Uminf ]T |a fciV>(£) 1 1| / fciV>(£) (y ) II* < CM" . (4.22) 
00 fc=i 

This ends the proof of (|4.18|) . 

Proof of P~T9j) , For any non negative integer j, let 

2 j +e 2 j +e 

Aj~ sup | V (E i - 1 (d i 2 )-E{d i 2 ))\= sup | V (Ei_i(d/i)- 1(^)1, 
i<^< 23 . =2 , +1 i<f< 23 . =23 . +1 

where d,- tj is defined in (gUJ. Let JVeN' and let k e]l, 2^]. We first notice that A, > | E^j" +1(^-1(^1 )" 
E(d|J)|, so if if is the integer such that 2 K ~ 1 < k < 2 K , then 

k N-l 

| Y(^i-i(di) - E (^7))| < |Eo(4) - E K 2 )I + E A i ■ 

t=l j=Q 

Consequently since K < N, 

k N-l 

sup | Y( E i-i(%) - E(d?))| < |E (4) - E(4)| + (4.23) 
i< fc < 2 " i=l i=o 



Therefore to prove (|4. 19[) . it is enough to show that 



l<fc<2i 

In particular, it suffices to prove that 



k+2 j 

su pJ E ( E i-i(^!i)- E K-i))| <2 2 ^-i-4/ P a . s . 



^ II su Pl < fe < 2J I Ei*=i(Ei-i® -E(^ 4 ))| 2 

E 2^/Pj2(l-4/p) " < °° • ( 424 ) 
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Observe now that, by Claim Q] and condition (|4.ip . (djijigz forms a stationary triangular sequence of 
martingale differences in L . Let 

n 

Mj,n ■= E ■ 
1=1 

Applying Proposition 2.3 in [32] and using the martingale property of the sequence (Mj, n )n>x, we get 
that 



k 2 



sup | J2^i-i(df,i) - « nq^j 



Kk<2i 



^ ||E (M| 2fe )-E(M| 2fc )|| 2 ' 



2 ' \^ 2 fc / 2 

i=l \/c=0 



Noticing that 1 1 rf? 1 1 1 2 = IMi.ilIti an d using the computations made in (|4.22|) . we get that 



E 



2 4j7pj2(l-4/p) 



< OO . 



Therefore to prove (|4.24[) . it remains to prove that 

j—X 

E 2 4 3 /Ja- 4/P ) (E 2 ' fc/2 n E o(^) -nMi^)h) 2 < 00. 

j>l J k=0 

Setting Sj iTl = Yn=x and = Sj. n — Mj <n , according to the proof of Theorem 2.3 in [3], this will 
hold provided that 

E ^/pL/p) ( E 2- fc/2 ||Eo(^ 2fc ) - E(^ ) || 2 ) 2 < 00 , (4.25) 

j>l J k=0 



E 24j / P? 2 (1 - 4 / P ) (E 2 ' fc/2 |l^ll4) <«>, (4.26) 

j>l J k=0 

and 



j—X 

E 2 4 j/P7 2a- 4/rt (E 2fc/2 E ll^fe)l| 2 ) 2 < 00. (4.27) 

J>1 J fc=0 ^>2 fc 



According to the proof of Claim [21 



Pi^lU « (^(0i, Y W) 3/4 )liminf ^ |a^ (L) ||! 5 , o/^ (L) (r )|| 4 . 



L— f 00 

£>1 i=l 



Therefore, since Yli=x \ a i,<p(L)\ < 1) using Jensen's inequality and condition (|4.ip . 

E 2 4 J 7„ 7 -2(l-4/p) ( E 2_fe/2 H%2 fc 111) 
j>l J k=0 

« E K^l E 2 4 J 7 P? -2(l- 4 /p) E (/^(£)( r ") 1 |/,. y (^)(yo)l<2 J 7P J -2/P J , 

i=l j>X J 

which together with an application of Fubini show (|4.26[) . We turn to the proof of (I4.27[) . According to 
Lemma 5.1 in 0], 

2 fc / 2 ^ ||P (^)||2« £ l|E fe)|| 2 . 

l>2 k £>2 fe " 1 

Since ||Eo(X^)|| 2 < lim inf J2f=x \ a i, v (L)\\\^o{gj fiML)( Y e)) - E (9j ft, v (L)(Y e ))\\ p , by Lemma[43| 
and using the fact that Ylt^x \ a i,v(L)\ — ^ we derive that 

||E (X^)|| 2 « M(cj>x^)) (p ' 1)/P ■ 
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Since p < 4, we then infer that fi^Tj) will hold if J2e>i 0i,y W) (p_1)/p < oo which is satisfied if flU) is. 
It remains to show that (I4.25[) holds true. Since 



2 K 2 K -m 



m=l f=0 

we infer that there exists C > such that 

22- fc / 2 |!E (^ 2 ,)-E(^ 2fc )|| 2 

k=0 

- ^ E E 7 T i\l/2 ll E o(^j,m^j,m+l) - E (^i,m^,m+^)|| 



^ (m + l) 1 ^ 1 



2 



where 



2 3 [m T ] 2 3 2 3 - 

m=l fcO V ; m=\t=\ m ~<\ y ' 



7j(7" ,m,^) := ||E (X,-, m Xj, m+ ^) - E(Xj, m Xj, m+ ^)|| 2 and 7 € (0, 1] . 



Bounding up 7j(J-"o,m,£) in two ways as done in the proof of Corollary 2.1 in [4], we infer that, for any 
7 G (0, 1] (to be chosen later), there exists a positive constant B such that 



J- 1 



k=0 

where 



(^2- fe / 2 ||Eo(^ 2fc )-E(^ 2 .)||2) <Bll + BI 2 2 (4.28) 



/i=E^72 SU P \\ E o( x j,e x j,k)-H x j,e x j,k)h 

TYl 1 £>k>m 
rn — 1 — — 

,^^1/(27) _ s2 

2 =(E^T7^H E ofe)IU) • 



fc=l 

We shall proceed by using some arguments developed in [5] to get their bound (5.7). Arguing as in the 
proof of Claim [3l we obtain that 

;l/(27) 2 jy 2 

h < 8^2( E ^TT^^i.vW 3 / 4 ) hminf ( £ |a^ (i) |E(// jV(i) (r )l| W)(yo) ,< c(j) )) . (4.29) 

fe>0 £=1 

We bound now Ji. According to the proof of Claim [TJ Xjj is the limit in L 4 of (Xj t L,e)L, where Xj,z,,« 
is defined in (|4.6p . Therefore, 



HEopO,^- fc ) - E(X^X iife )|| 2 = lim \\E {X jtLA X j>L!k ) - E(X jtLtt X jtLi1e )\\ 2 . 

L— too 

Applying Lemma |4.3[ for £ > k > m, 

W®( X j,L,t X j,L,k) " ^{ X j,L,l X j,L,k)^2 

< 1602,yM 1/2 E \ a i,fiL)\\\9j ft, V (.L)(yb)\U E \ a K V (L)\\\9 3 ° fk, V (L)( Y o)\U ■ 

e=i k=i 

It follows that 



23 l> . . t /<>\ ./^. , U/ 2 



J i ^ ( 16 E £i72^,y(™) 1/2 ) Hminf ( £ I^^dIE^^l)^)!,^,^,^^)^^,))) . (4.30) 



m 

m=l 1=1 
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Let 7 = l/-\/3- If the condition (|4.1[) holds, then 

fc>0 m>0 

We infer from ([OS]) . P~2l))) and (|4~3(J)) that, if (|4~Tj) holds, there exists a positive constant C 4 (0) such 
that 

3-1 2 V(i-) 

(^2- fc / 2 ||E (5 2 2fc ) -E(^, 2fe )|| 2 ) < C 4 (0)Krninf £ |o^ W |E(^ v(i) (yo)l| Ai , w (y )|<cO)) ■ (4-31) 

fc=0 1=1 

Using this last bound, Fatou's lemma together with Fubini, we then infer that (|4.25p holds true. This 
ends the proof of ![3~T2"]) . □ 

End of the proof Theorem SH for p e]2,4[. To finish the proof of Theorem W3 for p e]2,4[, it 
remains to prove our claims. 

Proof of Claim [TJ Notice that (Xj^t) converges in h p to Xjj and ||-Xj £,<||oo < 2c(j). Therefore, we 
infer that H-Xj^Hoo < 2c(j). It follows that X/^ = hmx-^oo X^l,,1 m for any q £ [l,oo[. Next, by 
Lemma [4~3l and the fact that J2k=i \ a k, v (L) \ < L we get that 

V (L) 

||Eo {X jtL4 ) \\ q <Y, K^)IPo (9j ° fk tV (L)(Y t )) -E( 9j of kML) (Y e )) ^ 

k=l 

< ^x,-y{l) J2 \ a kML)\\\9j ° fk, v (L)( Y o)\\oo < 4c(j>i,yW ■ 

fc=l 

Therefore ||E (X jt i) \\ q < 4c(j)0i iY (^)- This proves the claim. □ 

Proof of Claim [2} Let Sjx.k = Yli=i Xj,L,e where Xj t Lj is defined by (|4.6|) . Recall that Xjj is the 
limit in L p of Xj^j. Clearly, to prove (|4.14l) . it suffices to prove that, there exists some positive constant 
K, such that for any positive integer L, 

II SUPl<fc<2J |%L,fc|||| . . 

2 2 J/fj 2 - 4 /P < [ 6 ' 

To prove (|4.32p . we use the maximal inequality of Peligrad and Utev (2006). Therefore, by stationarity, 

j 2 

|| max. |S il£lfc |||a « V\\X^ \\l + V (j^^llMS^L^h) 

£=0 

2j „ 2 

«2^||^- L .o||^ + 2^(^fc- 1 / 2 ||Eo(X J , L!fc )|| 2 ) . (4.33) 



fe=i 

2 



Notice that HXj^oHl < 4 (xXii ) a ^v(L)llft ;0 AvwWH 2 ) ■ Therefore, since Y!i=\ WA < 1, by 
Jensen's inequality, 

ll^.olll < 4 ]T |a,,„ (i) |||& o /^ (i) (Yo)||l . (4.34) 
i=i 

Now 

l|Eo(^,L, fe )|| 2 < Y, \ a ^)\\\M9i ° W)Cn)) - mj ° /^(L)(n))|| 2 . 



C=l 



Applying Lemma S31 ||Eo(& o f eML) (Y k )) - E{& o f ^ {L) {Y k ))\\ 2 < 2(20 1 , Y (fc)) 1/2 ||ff J o f lML) (Y )\\ 2 . 
Hence by Jensen's inequality, 



2 3 . o . 2 v( L ) 



(^fc-^HEo^-,^)!!,) < 8(^A;- 1 / 2 0^(fc)) Yla^lUof^iYo)^. (4.35) 



fe=i fc>i i=i 
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2 

2 ■ 



Therefore, using (I4.33[) together with the upper bounds (|4.34[) and (I4.35[) , we derive that 
\- l|ma Xl < fc < 2J |%L, fc |H| 2^-2)/^ ; 

2 2 j/P o2-4/ P « ? 2( P -2) /?) (Z^ fc <W*0) E l^(L)lllffi°//, V (L)(^0)ll 

i>i J J k>l l=\ 

Now, via Fubini, there exists a positive constant C not depending on L such that 

Zv 7 -2(p-2)/pH^ °/«,v(i)( r 0)ll 2 = 2^ 1 -2(p-2)/p E (4 V (i)( r °) 1 |/*,^(l,)(>o)l>2^P 3 -2/pJ 

<C\\f iML) (Y W p <CMr 

Using condition f)4. 1 5[) and the fact that Y^=v \ a i,v(L)\ < 1' (|4.32p follows. This ends the proof of the 
claim. □ 

Proof of Claim [3j For any positive integer k, let Sj,k = Yli=i Mj.k = 2/=i dj,e and 

Rj.k = S jtk - M jtk . (4.36) 

By stationarity, and since for any k > 1, Eo(Mj,fc) = 0, according to Corollary 3 in Mcrlevede and 
Peligrad [20], 

j'-i 

II sup |£ Jifc | || 4 < ||i?,, 23 || 4 + 2-''/ 4 Z ^2^/ 4 ||E (% 2! )||4 
i<fc< 23 ;=0 

2 J 

«P J ,L,2 3 ||4 + 2^^r 1 / 4 ||E (^)|| 4 . 

Now according to item 2 of Proposition 2.1 in [4 applied with N — 2 2j+1 , we get that 

ll%2,||4«5]||E (^)|| 4 + 2^ 2 J2 ll p ofe)|| 4 . 

1=1 £>2 2 i 

Using then Lemma 5.1 in 4 , it follows that 

2 2j + l 

\\R j>2i \U< E Pofe)|| 4 + 2^ J2 fc- 1/4 ||E fe)|| 4 . 

1=1 (>2 2 i 

So overall, 

II sup \R hk \ || 4 

l<k<2i 

< E ||E fe)|| 4 + 2^ £ fc- 1 /4|| Eo( ^)|| 4 + 2^^r 1 / 4 ||E fe)|| 4 

f=l £>2 2 J 1=1 

2 3 

< 2^^ r i/8|| Eo( ^)|| 4 + 2^ 2 E ^ 1/4 ||E (^)|| 4 . (4.37) 

£=1 £>2 2 J 

We handle now the quantity ||Eo(Xj j £)|| 4 . We first observe that by Lemma |4~31 

||E (X^,,) || 4 < 4(^, Y (f)) 3 / 4 E KvWlHft ° /fe )V (i)( y o)||4 , 

fe=l 

where Xj t L,e is defined in (|4.6I) . Taking into account (|4.21l) . (|4.37l) and the condition (14.17[) . we then infer 
that 

2 3 X 4 
II ^ U P 2 . |-%k| 1 1 4 < 2 4j/pj4(p~2)/p U j^™ f ( Zv I a fc,v(i)lll5j ° /fc, V (L)(^))|| 4 
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Since, X)T=i l a f.^(i)l < 1> by Jensen's inequality 



l<k<2i ^ 2 4 3/Pj 4 (P- 2 )/P E l a fc^(i)Hl5j ° A-, V (L)(>o)||4 ■ 



Now, via Fubini, there exists a positive constant C not depending on L such that 



2 4j/p o4(p-2) /p 1 1 S'i ° fk^(L)(Y )\\\ - 24j/pjHp-2)/p E (ftv(L)( Y o) 1 \h, v{L) (Y )\<V/pj~VP^ 
j>0 J j>0 J 

^ E (tw) E WkdW) 1 !/,^^^) < ^11 W)(*b)||* < 



i>0 



which combined with the fact that X}T=i I a ^.<p(^) I ^ ^ prove the claim. □ 
Proof of Claim [4] We first prove that 

a 2 = lim n^WMnWWl. (4.38) 



Recall that (|4.1D entails in particular that J2k>o \\Po(Xk)\\2 < oo. We then define do — J2i>o Po{f(X )o9 l ) 
and for any integer I, dg = d o 9 e . Let M n (f) = 2"=i Since X)fc>o H-fbP^jOlh < oo, using item 2 of 
Theorem 1 in [25]. 

||S n (/)-M n (/)|| 2 = (^). (4.39) 

Since cr 2 = lim„^.oo ra _1 ||i>„(/)||2, it follows from (|4.39[) and stationarity that a 2 = n _1 ||M n (/)||2 = E(d§). 
We show now that 

||M„(/)-M„(/)|| 2 = (n 1 / 2 ). (4.40) 

Let JV be the positive integer such that 2 N ~ 1 < n < 2 . By the martingale property of M n (f) — M n (f) 
and stationarity, we have that 

n N—i 
\\M n (f) ~ M n (f)\\ 2 2 = E E (^ - d ^ 2 ) ^ E (( Jl " dl ) 2 ) + E 2JE (( dl " J JM) 2 ) • ( 4 ' 41 ) 

£=1 j=0 

But di — dj.i = J2e>i Then, by Lemma 5.1 in [3] (see also the proof of Corollary 2 in [25]). 

||di - 4i|| a < £ H P ofe)||2 « $> + ir 1/2 HEofe)|| 2 . 
e>o e>o 

Let Xj t L^ be defined in (I4.6[) . Applying Lemma POl 

¥>(£) 

HEofc^lla < 2V2(0 1 , Y (£)) 1 / 2 £ |a W )|||^ ° fk, v (L)(Y )h ■ 

fc=i 

Since X^li* l a fc !¥ ,(L)| < 1 and fk.-p(L) belongs to Mon p (M, Py ), it follows that 

||Eo(Xm^)||2 < 2V2Aff/ 2 (c(j)) 1 - p/2 (0i, Y (A ; )) 1/2 . 
Since ||Eo(Xj,i)|| a = lim L ^oo Po(^, M )|| 2 and, by condition gJJ, Ek>i k ' 1/2 ^( k ) 

< oo, we get 

overall that 

JV-l 

\\Mn(f) - M n (f)\\l « E 2j ( c U)) 2 ~ P « 2 2N ^N 2 ^ 2 ^ , 

proving (|L40]l . Combining the fact that cr 2 = n _1 ||M n (/)||| with fOO]) . it follows that (|4~38l) holds. 

Then, according to Theorem 2.1 in [26] . we see that, enlarging our probability space if necessary, one 
may find a sequence (Ze)e>i of independent Gaussian random variables with zero mean and variance 
E(Z e ) 2 = E(d e ) 2 = (at) 2 such that 



sup 

Kk<r, 



M k - ^ZA = o [a]! ' 2 (log n) 1/2 ) almost surely, as n -> oo. (4.42) 



16 



Let (Sk)k>i be a sequence of iid Gaussian random variables with mean zero and variance a 2 , independent 
of the sequence (Zg)g>\. We now construct a sequence (Zg)g>i as follows. If ag — 0, then Zg = Sg, else 
Zg = (a/ag)Zg. By construction, the Zg% are iid Gaussian random variables with mean zero and variance 
a 2 . Let Gg = Zg — Zg and note that (Gg)g>\ is a sequence of independent Gaussian random variables 
with mean zero and variances Var(G^) = (cr — ag) 2 . Assume that we can prove that 

y^^<oo. (4.43) 
^ 3 a„logn 

Then by the Kolmogorov theorem (or Lemma Rr2"j) . it will follow that the series J2 n >3 ( a lo^n) 1 / 2 conver g es 
P-a.s. Hence, Kronecker lemma will imply that X)"=i @l — °(( a n logn) 1 / 2 ) P-a.s. Therefore starting from 
(|Q2"]) . we will conclude that if (|4~T5| and (ICT?)) hold then (|4"?P2"j) does. Let us prove P~4"3"]) . With this 
aim, we first notice that 

e(g£) = (IKH2 - Il4|| 2 ) 2 < ||4 - 4111 • 

Next 



2 J + 1 

yj^i_L < Y 1 y E ((d i -d ji ) 2 ) = y T/ E((d t - <?,- 1) 2 ) . 

^a„log?i ~~ ^ 2 2 3/Pj 2 - i /P ^ 1 l-^i 22j/p ? -2-4/ P ; 

n>3 & j>l J £=2) + l i>l 



E(G 2 ) x 1 x — ^ -m// 7 t \ - 2^ 



Using the computations as done to prove (14.40[) . we infer that under condition (|4.1| . 

E(G 2 ) 2 J ' ,^( L ) 

n>3 J>1 fc— 1 

Since Yl^—i \ a k^(L) \ ^ 1? Jensen's inequality leads to 

n>3 b j>l J k=l 

Hence, by Fubini theorem, there exists a positive constant G not depending on L such that 

n>3 J>1 fe=l 

« Hminf ^ |a fe , p(i) | £ (-^J E (/L(L)( y o)% fc ,,<,)(^)l>2^- 2 /'' 
fe=i j>i J 

V (L) 

< Ghminf J2 \ak, v (L)\\\fkML)(Yo)\\ p p < CM?. 

°° k=l 

This ends the proof of (|4.43p and of Claim [H □ 



4.2 Proof of Theorem 14.21 for p = 4 

In this case, no truncation is needed. The beginning of the proof of Theorem 14.21 for 2 < p < 4 also 
works for p = 4. In particular, if / 6 MonJ(M, Py ), condition (|4.1[) implies that X^>o ll^o(^)IU < °°- 
Therefore the series a 2 = J^kez Cov(Jf , Xk) converges absolutely and lim^oo n _1 E(S' 2 (/)) = a 2 . In 
addition the series J2k>o ^0 (Xk) converges in L 4 and the sequence [dg)g^j J defined by: 

d t = ^P t {X k ) (4.44) 

k>e 

forms a stationary sequence of martingale differences in L 4 with respect to the non-decreasing sequence 
of (7-algebras Hence, setting for every positive integer n, 

n n 

M n (f):=Y,di and := , 

i=i 1=1 
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the conclusion of Theorem 14.21 when p — 4 will follow if we can prove that 

sup \S n (f) - M„(/)| = 0(n 1/4 (logn) 1/2 (loglogn) 1/4 ) almost surely, (4.45) 

l<fc<n 

and if, enlarging our probability space if necessary, there exists a sequence (Zj)i>o of iid Gaussian random 
variables with mean zero and variance a 2 such that 



k 

sup I VVdi - Zi) = 0(n 1/4 (logn) 1/2 (loglogn) 1/4 ) almost surely. (4.46) 

!<*<-- 1 Z — ' 



i=l 



To prove (|4.45p . it suffices to notice that since J2e>o ll-^o(^)||4 < °o, we have the coboundary decom- 
position S n (f) = M n (f) + ?'o -ro° n with 1 1 r*o 1 1 4 < 00. So (|4.45p follows directly from the fact that 
(r - r o 6 n )/n l / A -> P-a.s. To prove (|4.46p , we shall use Remark |2.9l Therefore we need to show that 

n 

^(E(4|J- fe _i) - E(4)) = 0(n x / 2 (loglogn) 1 / 2 ) P-a.s. 
fe=i 

This condition follows directly from Theorem 12 of [HI] together with the fact that (dk)k£f$ is a martingale 
differences sequence provided that 

£ i^l!||E (M 2 ) -E(M 2 )||| < 00. (4.47) 

n>2 

According to the proof of Theorem 2.3 and Corollary 2.1 in 0], this will hold true provided that there 
exists 7 €]0, 1] such that 

J2^ognfn^ + i\\E (X n )\\l < oc , (4.48) 

n>0 

and 

^(logn) sup IIEoPW - Ef-YiXOIl! < 00 . (4.49) 

n>0 

Notice that ||E (X n )|| 4 = lim^^ ||E (/ L (y„) - E(jx(F„)))|| 4 < liminfi^ ££ =1 l«fc,^ I Po(/fc,i(^) - 
E(A, £ (y„))|| 4 . Next, by LemmalU ||E (/ fc ,£(Y„) - E(f hL (Y n ))\U < 2M(2^, Y (n)) 3 / 4 . On the other 
hand, 



L L 

oiXiXj) - E(JQJ^)|| 2 < liminf V V \a klL \\a e , L \ \\Mh,L{ Y i)hA Y i) - WkA Y i)hA Y 3)h > 

L— >oo z — ' * — * 



k=l 1=1 

and by Lemma 14.31 

sup m (fk,L( Y i)UA Y j) - nfkA^)fiA Y j)h < i&m 2 ^^)) 1 ' 2 . 

i>j>n 

Hence condition (I4.1j) (for p = 4) implies that (|4.48|) and (I4.49j) hold for 7 = l/\/3. The proof of Theorem 
14.21 is therefore complete. □ 

5 Proof of the results of Section [3] 

5.1 Proof of Theorem 13.41 on uniformly expanding maps 

Item 1 follows directly from Theorem 14.21 Indeed since T is uniformly expanding, it follows from Section 
6.3 in [8 that 

4>2,yr(n) = 0(p n ) for some p e (0, 1) . (5.1) 

To prove Item 2 we proceed as follows. We start by the case p s]2,4[. Since / <E Monp(M, v), we 

consider the function fj and the random variables Xj yk and Xj^ defined in the beginning of the proof of 
Theorem 14. 2 1 In addition we set 

J r k = a{Y i ,i<k) and Q k = a{T\i>k) . (5.2) 
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As in the proof of Theorem 14. 21 we define a sequence of martingale differences, (dj t e,)t>i, with respect to 
the non-decreasing sequence of cr-algebras (J c e)e>i, as follows: 



k>( 



k>e 



and we recall that by Claim[T]and by (|5.ip . the series ^2 k>0 Po (Xj,k) converges in L°°. Notice now that 
by the Markovian property of (ii)<>o, we have that 



dj,e = E ( E i X iA y t) - E ( X jM Y i-i) ) := m(Yi,Yi-i) 



where m(-, •) is a measurable function from R 2 to M. Define now 

d* A = m{T l ~\T l ) . 



(5.3) 



(5.4) 



Notice then that d* e is Ge-i -measurable. Moreover, since on the probability space ([0, 1], v), the random 
vector (T, T 2 , . . . , T n ) is distributed as (Y n ,Y n -i, . . . , Yi), we have that 

m(d*. e \5i)\\i,» = ||E(d^|T«)|| v = ||E(^l^-i)llli = 0, 

it follows that E{d* e \g e ) = v-a.s. 

We define now some non stationary sequences (X£)e>i and (<i| )^>i as follows: 



d\ := d* l x , X{ := /i o T — v{fi o T) , 
and, for every j > and every £ € {2- J + 1, 2 J+1 }, 

:= d' u , X; := /, o T l - u(fj o T l ) . 
For every positive integer n, we then define 

n n 

K(/) == E^ and s n(/) : = E^* • 

£=i i=i 

Therefore, Item 2 of Theorem 13.41 will follow if we can prove that 



(5.5) 



(5.6) 



Kfc< 



sup \ Y,UoT i -v{f))-S* k {f)\=o{n 1 ^{\ogn) 1 - 2 ^) z/-a.s. 
S* k (f) ~ M fe *(/)| = o(n 1 /P(logn) 1 - 2 /f) „- a . 8 . , 



sup 

Kk<n 



(5.7) 



(5.8) 



and if, enlarging our probability space if necessary, there exists a sequence (Z*)i>Q of iid Gaussian random 
variables with mean zero and variance a 2 such that 



sup |EW-^i) =o(n 1 / p (log n) 1 - 2 ^) i/-a.s. 



Kfe< 



(5.9) 



According to the proof of Theorem 14.21 (|5.7p will hold if 



E 2- 2 '>r 2+4/ i | £ ((/ - /i) ° v(f - /,)) 



< 00 . 



2.;/ 



(5.10) 



But, since on the probability space ([0, 1], v), the random vector (T, T 2 , . . . , T n ) is distributed as (Y„, Y n _i, . 
according to the inequality (4.1) in [5], we have 



v { | E ((/ - fi) ° T ' - <f - h))) 



> x < 



re 

D f2 max I y^X- 



> x 
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Therefore (pTTU)) follows from Claim [2J 

We turn now to the proof of (|5.8p . According to the proof of Theorem 14.21 (|5.8|l will hold if 

E T*l*j-*-*M J nj« | £ (/j o - v{fj) - d*J |||* < oo. (5.11) 

But, as before, since on the probability space ([0, 1], f), the random vector (T, T 2 , . . . , T") is distributed 
as (Y n ,Y n -i, . . . , Yi), 



K K 

v { ™ a < x 2J 1 E (£ ° T ' - v tis) - d h)) \ >x )^ p ( 2 ™» | E^ - 



> X 



Therefore (|5.1ip follows from Claim [3] 

To prove (|5.9|) , we shall proceed as for the proof of (I4.12p with the difference that Theorem 12.31 is 
used instead of Theorem 2.1 in [26]. So we have to prove that 

n 

E (E(«) 2 |r) - E((d*) 2 )) = o(a n ) a.s. , 

i=l 

where a„ = n 2 / p (logn) 1_4 / p . But following the proof of (|4.19[) . this will follow if we can prove that 

£2-4^-4(1-2/,,) JE( E ((<i) 2 | Ti )- E ((4i) 2 ))l 2 <0 °- ( 5 ' 12 ) 

z — ' Kfe<2J z — ' 2,1/ 

j>0 ^ ^ i=l 

But using again the fact that, on the probability space ([0, 1],^), the random vector (T,T 2 , . . . ,T n ) is 
distributed as (Y n , Yn-i, . . . , Yi), we have that 

k k 

v ( ™* I E ( E (K*i) 2 i Ti ) - E (( d j.i) 2 )) I > *) < p( 2 sss ■ I E (^-i^i) - E (^)) I > a 

V Kfc<23 * — ' / V Kfe<2J 1 z — ' J 

- i=l - - i=l 

Therefore (|5.12l) follows by the fact that (|4.24l) holds true. This ends the proof of Item 2 of Theorem [ 
when p e]2,4[. 

We turn now to the proof of Item 2 when p = 4. Let X, = /(Yi) — According to the beginning 

of the proof of Theorem l4.2l (|5.ip implies that Ylk>i ll-^C-^kl^OlU < °°- We define a sequence {de)e>\ of 
stationary martingale differences with respect to the non-decreasing sequence of cr-algebras (Ft)t>i and 
that are in L 4 as follows: 

k>i 

By the Markovian property of (Yi)i>o, 

dt = E i x k\ Y i) - E {Xk\Y t -i) ) := m{Y t , Y^ x ) , 

k>l 

where m(-, •) is a measurable function from R 2 to R. We define now 

d\ =m(T e -\T e ). 

As before, notice that d\ is Ge-i -measurable and satisfies E(d* e \Ge) = 2/-a.s. According to Corollary 
12.71 the result will then follow if we can prove that 

n 

^(E((4) 2 |^)-E((4) 2 )) = O(n 1 / 2 (logl0gn) 1 / 2 ) u-a.8. (5.13) 

fc=i 

But E((d*) 2 |^ fe ) = E((d*) 2 |T fe ) := h(T k ) v-&.s. where h(-) is a measurable function such that v(h 2 ) < oo. 
Let h = h — v(h). Assume that we can prove that 

^ Ah + Kh + ■ ■ ■ + K^hU u 

^(logn) 3 - - 2 ^ < oo . (5.14) 

n>l 
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This condition implies in particular that J2n>i ^ h+Kh+ " n t/f h ^ 2 >" < oo. By Lemma 2 of [19] (and its 

proof), it follows that ^(Yo,^) : = lim » h E"=i Ei=o(^ fe ^( y i) - K k h(Y )) exists in L 2 and M n ((p) := 
y~], ip(Yk~i, Yfe) is a martingale with stationary increments such that 

ito + • • • + to - m„mii 2 « v^E £±^±^^ . 

k>n 

Since the random vectors (Id, T, T 2 , . . . , T"" 1 ) and (Y n , Y n _x, . . . , Y±) have same distribution, we can 
write M*(tp) := ££ =1 Tfc_1 ) = £fc=o v{T n ~ k , T^- 1 ). Then (M*) is a sum associated to a 

stationary sequence of reverse martingale differences and 

\\h + - + lo t- - M^ )h , v « ^£ iA±^±__+^Mv . (5 . 15) 



Therefore, by Corollary 4.2 of [5] with = logn, if 



J2 ^\\h + ■ ■ ■ + h o T"" 1 - M^MII t < oo , (5.16) 



then _ 

/ l + --- + / l oT"- 1 -M;( ¥ .) 







V« log log n 

Using (|5.15p . it is easy to see that (|5.16[) holds as soon as (I5.14p is satisfied. Using then Corollary 12.5 
to observe that M*(ip) = 0(-y/nloglogn) v-a.s., we conclude that f|5 . 13[) (and then Item 2 when p = 4) 
holds as soon as (|5.14p does. Notice now that (|5.14[) can be rewritten as 

n>l 

that is exactly condition (|4.47p . □ 



5.2 Proof of Theorem 1331 

The proof follows directly by analyzing the proof of Theorem 13.41 when p = 4. Indeed, the proof reveals 
that if the conditions (|4.48p and (|4.49l) hold for Xi — f(Yi) — v(f), then the strong approximation principle 
holds for both " K/)) and £™ =1 (/ of- v{f)) with rate O^/^logrif/^logrilogri) 1 / 4 ). 

The condition Q3.2p (resp. Q3.3p ) is exactly the condition (14.481) (resp. (|4.49p ) rewritten with the help of 
the transition operator K. □ 



5.3 Proof of Theorem 13.71 on uniformly expanding maps 

It suffices to verify the assumptions of Theorem [33] Using the first part of Condition (|3.4p and the fact 
that \f(x) — f(y)\ < c(\x — y\) where c is a concave and non-decreasing function, it follows from Lemma 
17 in that \\K n (f) - v(f)\\oo,„ < c(Cp n ). Therefore, (O is satisfied with 7 = as soon as (j3"3|) 

is. To verify now the condition p.3p of Theorem 13.51 we shall use similar arguments as those developed 
in the proof of Corollary 3.12 in [Jj. From Section 7 in [5], we know that for i and j positive integers, 
there exists (Y*,Y*) distributed as (Yi,Yj) and independent of Yq such that 

i||E(|y < -r/||yo) + E(|r i -y;||F )|L= su P He^^OI^-eW^OJL- 

2" 1100 heAiiR?) 

Notice now that for i > j > 0, by using the second part of Condition Q3.4p . 

sup HE^^y^lyoJ-E^,^))!! = sup \\K^oQ i _ j {h)-u(Q i - j (h))\\ 00 , u <Cpl. 

ftGAi (R 2 ) /i£Ai(R 2 ) 
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On an other hand, we clearly have that 

WtfK^tf)) - uifK^if))^ = HECfC^)/^.) - f(Y*)f(Y J *)\Y Q )\\ oo 

= \\mm) - f(Y*))f(Y 3 )\Y )-E(f(Y*)(f(Y*) - z&otol . 

Since / is continuous on a compact set, there exists a positive constant R such that ||/||oo < R- Hence, 

\\KHjK^(f)) vifKi-^mu* < R\\m<\Yi - ^i)i^,)L + R\\m<t\Yi y;m)\L ■ 

Since c is concave and and non-decreasing function, it follows that 

\\K^fK^(f)) - V {fK^(f))\U M < R\\c{n\Yi - iri|l r o))|| 00 + iZ||c(E(|lS--l7l|yo))L 

< Rc{\\E(\Y - Y*\\Y ) ||J +Rc(\\E(\Y j - F/||F )||J 

< 2Rc(±\\E(\Y i - Y*\\Y ) ^ + |||E(|3^ - ^U^L) ■ 

So overall, 

sup \\K\fK l -\I)) - v{f K^{f ))\\oo, v < 2Rc(Cp n ) , 

i>j>n 

implying that Q3.3[) is satisfied with 7 = l/v3 as soon as (|3.5p is. This ends the proof of the theorem. □ 

6 Proofs of the reverse martingale's results 

We start by recalling the following estimate of Hanson and Russo [T2l Theorem 3.2A] 
Lemma 6.1 Let (B t )t>o be a standard Brownian motion. Then 

lim Sup Sup — — — — ■ — [ + , S 7 : TTTT7 = 1 P-a.s. (6.1) 

(>oo<4 (2opog((* + a) /a)) + logloga]) 1 /2 

We also recall the following convergence result for reverse martingales. 

Lemma 6.2 Let (£ n )„>i be a sequence of variables in "LP , 1 < p < 2, adapted to a non-increasing 
filtration (G n )n>i- Assume that E(£ n |(? n +i) = and J2 n >i -^(l£«l P ) < 00 ■ Then J2 n >i^n converges 
P-a.s. and in L p . 

Proof of Lemma 16.21 The result is clear when p = 1, hence we assume p > 1. Notice that for every 
n > !> (J2k=n-i £fe)o<Z<n-i is a (<?„_;) <i<ri-i-martingale. Hence, by Burkholder inequality and using 
that x I-?- |x| p / 2 is subadditive, it follows that the exists a positive constant C p such that, for every 
1 < r < n, 

— — k—m k—r k—r 

So, (Z„) := (X)fc=i is Cauchy in L p , hence converges in L p , say to Z. Moreover, letting n — > oo in 
|, we see that for every r > 1 



E(max|Z m -Zn <C p ^E(|an 



fe>r 

which implies the desired result. □ 
6.1 Proof of Proposition [27X1 

The L 2 and a.s. convergence of J2k>i £ fc follows from Lemma \6.2{ By Theorem 2 of Scott and Huggins 
|25] . enlarging our probability space if necessary, there exists a Brownian motion {B t )t>0y & non-increasing 
filtration ( - H rl ) n( =N and a non-increasing process (r n ) n6 N adapted to (H n )neN, such that 

R n = B T P-a.s. 
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Moreover, writing t n := t„ — r n+ \ > P-a.s., we have 

E(t n \H n+1 )=E(£\g n+1 ) P-a.s., (6.3) 
E(tPj 2 \H n+1 ) < C p E(\£ n \r\g n+1 ) P-a.s. for every p > 1 . (6.4) 

Hence, using (|6.3|) twice, 

r n - E(t„) = r n - 8 2 n = (** ~ E(t k \n k+1 )) + V 2 - 8l P-a.s. 

k>n 

But it follows from (|2.2p and (|6.4I) that Yl n >i a n"^(^n) < 00 which implies, by Lemma HT2l that 
Sfe>i a fe — E(tfe|'Hfc-|_i)) converges P-a.s.. Then, by an analogue to the Kronecker lemma (see e.g. 
Heyde [H Lemma 1]), ^ k>n {tk — E{tk\Hk+i)) — o(a n ) P-a.s. Together with (|2.1[) . this implies in par- 
ticular that t„ — 8 n = o(a n ) P-a.s. 

For every t > define B t = tB 1 / t , and Bq = 0. It is well-known that (B t ) t >o is a standard Brownian 
motion. We have B Tn — Bg2 = T n {B\/ Trt — £17,52 ) + (r„ — ^JSi/^ . By the law of the iterated logarithm 
for (B t )t>o (or using that the suprcmum in (|6.1[) is greater than what we have for t = and s — 
1/51), we see that B 1/S 2 = 0(<5- 1 (loglog(l/(5 n )) 1 / 2 ) P-a.s.Hence since a n = 0(5 2 n ), (t„ - 5 2 n )B 1/&l = 
o(K log log(l/a„)) 1/2 ) P-a.s. 

Let us deal now with r n (B 1 / Tn — B 1 / S 2). With this aim, we shall use (I6.1|) . Since a n = 0(S 2 ) and 
T n — S 2 = o(a n ) P-a.s., we have |1/t„ — 1/S 2 \ = o(l/a n ) P-a.s. Define u n :— a n /(T n S 2 ), e n :— max(|<5 2 — 
T n \/a n ,Un 1/2 ), s n := |1/t„ - a n :=e„u„ and v„ := minl^l/J 2 ,, l/r„). Notice that a n -> oo, e n -> 0, 
w„ + s n = max(l/£ 2 , 1/t„) and |-B 1/Tn - B 1/l5 2 1 = \B Vn+Sn - B V J. By $n§, we have 

l-B'Un + s™ — B Vn | 



(2a„[log((w„ + a„)/a„) + log log a^) 1 / 2 
, -Bt+s — -Bt 

< sup sup 7- — - — — — — — — - — - , — > 1 P-a.s. 

i>oo< s <a„ (2a n [log((t + a n )/a„)J + logloganj) 1 /^ 

In particular, we have |-Bi/ T „ - = 0([e„u„(| log(<5 2 /(a„e„))| + loglog(u„e„))] 1/2 ) P-a.s. Then, 

using that | log(<5 2 /(a„e„))| < \\og(S n /a n )\ + |loge„| and that e n u n loglog(e„u„) = o(u„ log log w„), we 
obtain 

T n (B 1/Tn - B 1/S 2) = o([a n (\ log(<5 r 2 > n )| + loglog(a„/<£)] 1/2 ) P-a.s. , (6.5) 
which proves the result, since 1/8* = 0(l/a 2 ). □ 

Remark 6.3 It follows from the proof that the assumption (|2.2I) may be replaced by'^2 k>n (tk—E(tk\'Hk+i)) 
o{a n ) P-a.s. 

6 . 2 Proof of Theorem [2731 

Define £ n := X„/cr 2 . Then, since E{^\) = (a k — o-\_^)a~/,* \ by comparing sums and integrals, it follows 
that T, k >i E (£k) < °°- Using the notations U„ 2 = £ fc > n (E($|& + i) and <5 2 = E fc >„E(£ 2 ), and writing 
:= ELi( E (^fcl^+i) - HX 2 k )), we have 



fc>n re k>n K K ' 1 



Using (|2.4I) and that (er T i)„£N and (a n /<7 2 ) ne N are respectively non-decreasing and non-increasing, we 
obtain 

We want to apply Proposition 12 . 1 1 to (£„) with a n := an/a*. Using (|2.5p . we have 

i>l n>l 
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hence condition (|2.2p holds. It remains to prove that a n = 0{8 2 l ) and that otn/&n ~^ 00 • With this aim, 
we first notice that 

1 -«=E/: ; 



-2 



Hence, using that sup n E(X 2 ) < 00, it follows that a n = 0(a n -i) and 

1 i\ ./v-^-^La 







fc>« fc -l fc k>7 



In particular, since tf 2 , = 0(a n _- L ) — 0{a n 2 ) and \a n 2 — cr ra _ 1 1 = 0(er n 4 ), we have 



4 " € 



0(4). (6-6) 



Since a ra <7 n 2 is non-increasing, (|6.6[) implies that a n = (3(<5 2 ). In addition since a„ is tending to infinity, 
(|6.6I) entails also that a n /S„ —> 00. 



By Proposition 12.11 enlarging our probability space if necessary, there exists a standard Brownian 
motion (B t )t>o, such that (|2.3p holds with <5 2 = ^2 k>n { a 1 ~ °\-\) a k^ ■ Now, for every i > define 
B t = tBx/t, and Bq = (recall that (B t )t>o is a standard Brownian motion). Notice that 

B 1/oj . - B sl = a- 2 (B CT 2 - B 1/4 ,) + (a,; 2 - ^)S 1/5?i . 

By (I6.6[) and the law of the iterated logarithm for (B t )t>o, we derive that 

1/2 

(ct„ - $n)B 1/S 2 = 0(a n (loglog(cr„)) 7 ) = ol ^ * I P-a.s. 

To deal now with a~ 2 (B a -^ — Bi/$2 ), we use the same arguments as the ones used to derive (|6.5[) (with 
<7~ 2 replacing r n ). Hence we infer that 

1/2 

_2/5 5 s /(a„(|log(cr 2 /a„)| +logloga„)) \ 
a n \B al - B 1/S 2) = o[ ± = '- P-a.s. 



So, overall, it follows that 

1 /2 

id d 1 f Ml log(g£/nn)| + log log a n )) \ . . 

I-Rn - Si /(T 2 1 = ol ^ \ P-a.s., (6.7) 

where R n = J2 k > n x n/^l- 

Write Z n := a 2 (Bi/ a 2 — B^i J. By independence of the increments, (Z n ) is a sequence of indepen- 

1 

1+1 



dent centered Gaussian variables. Notice that, by stationarity of the increments E(Z 2 ) = cr 2 E(X 2 )/cr 2 +1 . 



We have 

n n n 

fe=i 

- B 1/ai )(4 - af_!) + aftife - B 1/al ) - al(R n+l - B y< ) . 



fe=i fe=i fc=i 



fc=2 



Using that (cr n ), (cr 2 /a„), (a n /cr n ) and (<z n ) are non-decreasing, and taking into account (|6.7[) . we deduce 
that 



n ^-2 „2 



sr v 7 ( f a "(l lo g( g £AOI + log log an) y/ 2 ^ \ - 

fc=l fc=l \ n / fc=2 V fe 



K) 3/4 



1 /2 

>MI log(cr 2 /a„)| + log log a„) 
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where we used that ££ =2 (^ - c^K)" 3 /" = °(fo" dx/x^). 

Finally, define Z n :— Z n a n +i/cr n . Notice that \Z n — Z n \ < C\Z n \/a n for some C > 0. Hence 
J2 n >i E((2"n ~ Z n ) 2 )/a n < J2n>i( a n ~~ °n-i) / °n < 00 ■ So, by the Kolmogorov theorem (see also Lemma 
, ^2 n>1 (Z n — Z n )/^/a^ converges P-a.s., and (|2.6p follows from the Kronecker lemma. □ 



6.3 Proof of Corollary 1231 

Assume that E(Xj) 7^ 0, otherwise there is nothing to prove. We start by the proof of Corollary 12.5 
Notice first that by stationarity and Fubini theorem, 



E(|X ?1 |l { | fn|>v ^ } ) =E , lWcE(X?)< 



n\x n \i UXn \>^}) 

n>l V" l<n<Xf 

Hence, 

^n-^PMl^^vM <°° P-a-s- and 5^n- 1 / 2 E(|X n |l { | JfB | >VS} |en+i)<oo P-a.s. (6.8) 

n>l n>l 

and by the Kronecker lemma, 

n n 

J2\Xk\l UXkl>V1 : } = o(V^) P-a.s. and ^E(|X fc |l {|Xfc|>v ^ } |^ +1 ) = (v^) P-a.s. (6.9) 
fc=i fc=i 

Define y n := X n l { | Xn |<^-E(X n l { | Xn |<^ } |S„ + i). Then, by the above, using that E(X n \g n+1 ) = 
a.s., we see that it suffices to prove (|2.7p with (X n ) replaced with (Y n ). 

We want to apply Theorem 12.31 to (Y n ) with a n = er^ — n. We have to prove conditions (|2.4[) and 
f2"3]) . Let us prove Clearly, (E(Y 1 2 ) H hE(Y"„ 2 ))/n E(X 2 ). Hence, we only need to prove that 

(E(Y 1 2 \g 2 ) + ---+E(Y r f\g n+1 ))/n^E(X 2 ) P-a.s. (6.10) 

We first prove that 

(E(Y 2 \g 2 ) + ---+E(Y 2 \g n+1 ))-(Y 2 + --- + Y 2 )=o(n) P-a.s. (6.11) 

By Kronecker lemma, this will follow from the convergence of the series 2 n (E(^, 2 |{?n+i) — Y 2 )/n. By 
Lemma r6.2[ this last convergence will hold true provided that ~Yl< n E{Y^)/n 2 < 00. But, by stationarity 
and Fubini theorem, we have 



£ ^ < l6E(xt £ 4) < CE(X?) < 00. (6.12) 



n>l n>X? 



Therefore (|6.1ip is proved. Now, by the ergodic theorem we have 

Um sup 11 '- J < hm — - = E(Xf) P-a.s. , 

n n n n 

and for any A fixed, 

k=l ^k L {\X k \<Vk} l^k=l JL k 1 {\X k \<A} wfv 2i \ to 

limml - — ■ > hm - — ■ = E(A q lnx, \<A\) P-a.s. 

n n n n 

Letting A — > 00, we see that the liminf and the limsup above are equal to E(X 2 ). Hence 

y^" x 2 i 

Lk=l k {\X k \<Vk} ^ E(X 2 } p_ a s _ ( g 13) 

n 

On an other hand using the fact that E(Xk\Gk+i) = a.s. together with (16.9[) . we get that 

n n 

n- 1 ^(E(X fe l { | Xfc |<yfc } |^+i)) 2 <n- 1/2 ^E(|X,|l {|Xfc|> ^ } |g fe+1 ) =o(l) P-a.s. (6.14) 

k=l k=l 
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Combining ([6TT5]) . (j6~Tl| and ([BTTT]) . we see that ([BTTU]) holds, which proves (|2~£|) . 

The fact that (|2.5[) holds with v = 2 follows from (|6.12[) . By Theorem 12.31 there exists a sequence 
of independent centered Gaussian variables (Z n ) n >i such that E(Z 2 ) = E{Y 2 ) = E(Jf 2 ) + o(l) and 

ii H Y n — (Zi + ■ ■ ■ + Z n ) = o(y/n log logn) P-a.s. Let (<5fe)&>i be a sequence of iid Gaussian random 

variables with mean zero and variance E{X 2 ), independent of the sequence (Z n ) n >i. We now construct 

a sequence (Z n ) n >i as follows. If E(Z 2 ) = 0, then Z n = 5 n , else Z n = c n Z n where c„ = ■J ^gl^ ■ By 

construction, the Z n 's are iid Gaussian random variables with mean zero and variance E(X 2 ). Write 
G n :~ Z n — Z n and := Ylk=i ^(^D- By Levy's inequality (see for instance Proposition 2.3 in 16 ), 

i=l 2 

Hence taking x = 2t>2>'(loglog2 r ) 1 / 2 , we get that 

k 

zZ P ( 1 ^ 2 ,]zZ G '\ > 2w2-(loglog2 r ) 1 / 2 ) < CO . 

Therefore sup 1</c<2 r |Sj=i^«| = 0(^2>-(loglog2 r ) 1 / 2 ) almost surely. P-a.s. This ends the proof of 
Corollary 12.51 since u 2 = o(n). □ 



6.4 Proof of Corollary I27TI 

Define Y n := X n l { \ Xnl < n i, P} ~E(X n l {lXn ^ n i /p} \G n+1 ). Since E(X n \G n+1 ) = a.s., 

^ E\X k -Y k \ ^ E(|Jr fc |l { | Xn |< fc i/,, } ) 

k>l k>l 

Hence by stationary and Fubini theorem, X)fc>i k^' p E\Xk — Y k \ < oo, implying via the Kronecker lemma 
that 

n 

J2\Xk-Y k \ = o(n 1 ^) P-a.s. 

k=\ 

Let us prove now that {Yn)n>i satisfies the conditions of Theorem 12.31 with a n = n 2 / p b(n) and a 2 = n. 
With this aim, we first notice that since E(X n \g n+ i) = a.s., 

E(X 2 \g k+1 ) - E(X 2 ) - E(Y 2 \g k+1 )+E(Y 2 ) = E(x 2 k i {lXkl>kl/P} \g k+1 ) - E(x 2 k i {lXkl>kl/P} ) . 

Since by stationarity and Fubini theorem, ^2 k>1 k ~ 2 / p E(Xj:l{\ Xk \ >k i/ P }) < oo, we conclude via the 
Kronecker lemma that 

n 

£ |E(^ 2 |^+i) - ml) - HY 2 \G k+1 ) + E(Y 2 )\ = o{n 2 ' p ) P-a.s. 
fc=i 

Together with condition (|2.8p . this implies that 

n 

^(E(r fe 2 |g fe+1 ) - E(F, 2 )) = o{n 2 H{n)) P-a.s. 
fc=i 

Notice now that by stationarity and Fubini theorem, 

n>l n>|Xi|P 

Therefore (Y n ) n >i satisfies (|2.5p with v — 2. Applying Theorem 12. 3[ we conclude that enlarging our 
probability space if necessary, there exists a sequence a sequence of independent centered Gaussian 
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variables (Z n ) n >i such that E(Z 2 ) = E(F„ 2 ) and Y x + • • • Y n - (Z x + • • • + Z n ) = o(n 1 /P v /fe(n) logn) P-a.s. 
We consider now the sequence of iid centered Gaussian variables (Z n ) n >x with variance E(X^) as defined 
in the proof of Corollary [53] Notice then that 

E(Z k - Z k f = (\\X k \\ 2 - \\Y k \\ 2 ) 2 <\\X k - Y k \\\ < E(X 2 k l {lXk>kl/p} ) , 

where for the last inequality, we have used the fact that ~E(X n \Q n+ i) = a.s. Hence by stationarity 

53 E (^« - Z n f/n 2/p < E(X 2 ^ l/n 2/p ) < CE(|X!| P ) < oo. 

n>l l<n<\Xi\v 

Therefore by the Kolmogorov theorem (or Lemma l(T2|) . Y^ n >i C^n ~~ Z n )/n 2 / p converges P-a.s. and by the 

Kronecker lemma Z\ + . . . + Z n — (Z\ + . . . + Z n ) = o(n 1 / p \/loglogn) P-a.s. This achieves the proof of 
Corollary E3 □ 



6.5 Proof of Corollary I2T81 

The proof relies more deeply on the construction of Scott and Huggins 25 . We want to use Theorem 
[573] without condition (|2.5[) . Now the proof of Theorem 12.31 relies on Proposition [57j] and (|2.5[) is used to 
ensure that condition (|2.2j) holds for an auxiliary process. Instead of (|2.5p we will make use of Remark 
16.31 We define a reverse martingale (R n )n>i, by R n = J2 k>n X k /k. Notice that R n is well defined in L 2 
by Lemma 16.21 

For every n < —1 define R n := R- n , X n := X- n and Q n := Q- n . Then (i?„, Q n )n<-1 is a martingale. 

Enlarging our probability space if necessary, we may consider a countable set of standard Brownian 
motions (B^ )t>o, n < —1 that are independent of each others and of (X n ) n <_i. Notice that the process 
(X n , (B^) t >o) n <-i with values in R x R R+ , is stationary. 

We now define a filtration (T-Lt)t<-i as follows. For n < — 1 an integer, write H n — G n V ^{B\ , < 
t < oo, — oo < j < n}. For every t < —1, not an integer, write H t = H[t] v {B[t]+i + ^$jv) > < s < 
t — [t]}, where [t] stands for the largest negative integer, not exceeding t, and <fi is defined on ]0,1] by 
<fi{s) := l/.s — 1. Then, we define a continuous martingale with respect to {Ht)t<-i interpolating (R n ), 
by Rt = ^(R[t]+i\Ht), for every t < —1. Notice that 

^ = ~ Rit] + m^) (616) 

Using Theorem A of [3S] as done page 451 of [2S], there exists a continuous non-decreasing process 
(%)t<—i an d a Brownian motion (_B t * ) t >o such that Rt — B~ a.s. and (R 2 — T t )t<-i is a martingale with 
respect to (Ht)t<—x- In particular, (r t ) t <_i must be the quadratic variation of (Rt) on ] — oo, i]. 

For every n > 1, define r„ := r_„, "H n := H- n - These are exactly the quantities involved in the 
proof of Proposition 12.11 Then t n = r n — T n+ \ is nothing else but the quadratic variation of (Rt) on 
[— n — 1, — n\. But it follows from (|6.16[) that (n 2 t n ) n >i is a stationary and ergodic process. 

By Remark 16.31 we need to prove 

53(t fe -E(t k \-H k+1 )) - 0(n- 3 / 2 v/loglogn) P-a.s. (6.17) 

k>n 

Since (n 2 t n ) n >i is a stationary and ergodic sequence in L 2 , it follows from Corollarv l2.5l that J2k=i k 2 (t k — 
E(t k \H k+ i)) = 0(-\/n log log 7i ) P-a.s., which proves (|6.17l) by an Abel summation. 

□ 
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